(19) 



EuropSisches Patentamt 
European Patent OfRce 
Office europden des brevets 



(12) 



(43) Date of publication: 

22.08^001 Bulletin 2001/34 

(21) Application number 01301366.9 

(22) Date of filing: 16.02.2001 



(11) EP1 126 415 A2 

EUROPEAN PATENT APPLICATION 

(51) lntCl7: G06T 15/60 



(84) Designated Contracting States: 


(72) Inventors: 


AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 


• Hlno,Aklhlro.c/oUvel-5INC. 


MC NL PT SETR 


Fukuoka-shl. Fukuoka-ken 810-0041 (JP) 


Designated Extension States: 


• Motomura, Kentaro, c/o Sony Computer 


AL LT LV MK RO SI 


Tokyo 107-0052 (JP) 


(30) Priority: 17.02.2000 JP 2000039820 


(74) Representative: Homer, David Richard 


24.01.2001 JP 2001015757 


D Young & Co, 




21 New Fetter Lane 


(71) Applicant: Sony Computer Entertainment Inc. 


London EC4A1DA(GB) 


Tokyo 107-0052 (JP) 





(54) Image drawing method and apparatus 

(57) A primary polygon ( 1 1 0) is processed to gener- 
ate new secondary polygons (110a, 110b. 110c) utilizing 
a light source (112) as a base point A front-side sec- 
ondary polygon (110a) is selected from the secondary 
polygons (110a, 110b, 110c) and drawn in a blackish 
color by rendering and hidden surface removal utilizing 



Z-buffering. Then, backside secondary polygons (110b, 
110c) are drawn by rendering and hidden surface re- 
moval utilizing Z-bufFering such that the color (blackish 
color) of the secondary polygon (110a) is eliminated. 
That Is, the eliminated portions of the secondary poly- 
gon (110a) become transparent 
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Description 

BACKGROUND OF THE INVENTION 

Field of the Invention: s 

[0001] The present Invention relates to an Image 
drawing method, and an image drawing apparatus 
which make it possible to draw images of shadows pro- 
duced by light emission from a light source, for example io 
vA\en based on a positional relationship of a plurality of 
objects generated by three-dimensional modeling such 
that shadow images of objects positioned near the light 
source are drawn on other objects positioned distantly 
from the light source. Further, the present invention re- i5 
lates to a recording medium which stores a program for 
carrying out such Image processing, and the program 
itself. 

Description of the Related Art: 20 

[0002] In recent years, there has been a rapid ad- 
vancement of computer graphics techniques such as 
hidden line removal, hidden surface removal, snrK>oth 
shading, and texture mapping thanks to the dramatic de- 25 
velopment of hardware. 

[0003] Generally, with the computer graphics tech- 
niques, images are generated by the following proce- 
dure. Firstly, a plurality of three-dimensional objects are 
generated by three-dimensional modeling. Then, ren- 30 
dering Is perfbnmed by adding optical properties such 
as specular reflection, diffuse reflection, refraction, and 
transparency to the objects with the shading technique, 
by adding surface patterns to the objects, and by plotting 
images depending on sun-oundings such as a window 35 
and scenery reflections and ambient light. 
[0004] It is difficult to perform a process of expressing 
a shadow of an object cast on another object positioned 
there-behined based on the layout of a light source and 
a plurality of objects. One rendering technique for per- 
forming the process is ray tracing. However, such a 
technique requires highly complteated calculations 
which put CPU or the like under heavy load. Another 
rendering technique for expressing a shadow utilizes a 
stencil buffer. However, the technique requires a stencil <s 
buffer as an additional mask (memory). Further, the 
technique requires a process of extracting an area cor- 
responding to a shadow from the stencil buffer and a 
process of drawing semi-transparent polygons in a 
blackish color in the extracted area. Therefore, the so 
number of the processes is increased. 
[0005] If heavy load and complicated processes 
should be avoided such as for real time rendering, then 
it has heretofore been customary to approximate such 
a shadow with perspective projection onto a simple ss 
plane in a simple figure such as a circle. 



SUMMARY OF THE INVENTION 

[0006] Embodiments of the invention seek to provide 
an Image drawing method, and an image drawing ap- 
paratus which make it possible to draw shadow Images 
of a plurality objects in a complicated positional relation- 
ship, and draw a shadow image of a complicated object 
without any difficulties. Embodiments of the present In- 
vention also seek to provide a recording medium which 
stores a program for cany Ing out such image processing 
of drawing a shadow image without any difficulties, and 
to provide the program itself. 
[0007] According to the present invention, an image 
processing method of drawing a shadow image of at 
least one primary surface constituting a three-dimerv- 
sionai object comprises the steps of: 

generating new secondary surfaces based on the 
primary surface utilizing a light source as a base 
point; 

drawing a first image of a front-side secondary sur- 
face selected from the secondary surfaces; and 
drawing a second image of a back-side secondary 
surface selected from the secondary surfaces, 
wherein the second image is drawn such that the 
first image is partially eliminated by the second im- 
age, thereby generating the shadow image of the 
primary surface. 

[0008] Further, according to the present invention, an 
image drawing apparatus comprises means for drawing 
a shadow Image of at least one primary surfoce consti- 
tuting a three-dimensional object, the means for drawing 
a shadow image comprising: 

means for generating new secondary surfaces 
based on the primary surface utilizing a light source 
as a base point; 

means for drawing a first image of a front-side sec- 
ondary surface selected from the secondary surfac- 
es; and 

means for drawing a second image of a back-side 
secondary surface selected fiiom the secondary 

surfaces, 

wherein the second image is drawn such that the 
first Image is partially eliminated by the second im- 
age, thereby generating the shadow image of the 
primary surface. 

[0009] Further, according to the present Invention, a 
recording medium records a program and data for use 
of an Image drawing apparatus for drawing image data 
In an image memory and outputting the image data 
drawn in the image memory to a monitor so that the out- 
putted image data can be displayed on the monitor, the 
program comprising the steps of; 

generating new secondary surfaces based on the 
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primary surface utilizing a light source as a base 
point: 

drawing a first image of a front-side secondary sur- 
face selected from the secondary surfaces; and 
drawing a second image of a back-side secondary s 
surface selected from the secondary surfaces, 
wherein the second image is drawn such that the 
first image is partially eliminated by the second im- 
age, thereby generating the shadow image of the 
primary surface. *o 

[0010] Further, according to the present invention, a 
program is readable and executable by a computer for 
use of an image drawing apparatus for drawing image 
data In an image memory and outputting the image data is 
drawn in the image memory to a monitor so that the out- 
putted image data can be displayed on the monitor, the 
program comprising the steps of; 

generating new secondary surfaces based on the 20 
primary surface utilizing a light source as a base 
point; 

drawing a first image of a front-side secondary sur- 
face selected from the secondary surfaces; and 
drawing a second image of a back-side secondary 2S 
surface selected from the secondary surfaces, 
wherein the second image Is drawn such that the 
first image is partially eliminated by the second im- 
age, thereby generating the shadow image of the 
primary surface. 30 

[0011] In embodiments of the present invention, it is 
preferable to utilize Z-buffering In performing hidden 
surface removal. 

[0012] Accordingly, it Is possible to easily generate 35 
shadow images of a plurality of objects in a complicated 
positional relationship, or generate a shadow image of 
an object having a complicated shape without using a 
stencil buffer. Since a shadow image is generated when 
the second image for partially eliminating the first image 40 
Is drawn, It Is no more necessary to draw semi-transpar- 
ent polygons in a blackish color in the last step. There- 
fore, the number of the processes can be effectively de- 
creased. In particular, three-dimensional infomnation 
conceming an object on which a shadow Is projected Is ^s 
not necessary in drawing a shadow image. That is, in- 
fomnation conceming two-dimensional images in an im- 
age memory and Z-buffer values for respective pixels of 
the two-dimensional images are only needed. 
[001 3] The primary surface may be drawn by render- so 
ing and hidden surface removal. Further, the first and 
second images of the secondary surfaces may be drawn 
by rendering and hidden surface removal. 
[0014] Further, according to an embodiment of the 
present invention, a series of drawing processes com- ss 
prising drawing of the primary surface, generation of the 
secondary surfaces, and drawing of the first and second 
images of the secondary surfaces are performed for 



every primary surface constituting the three-dimension- 
al object, thereby drawing an image of the three-dimen- 
sional object and a shadow image of the three-dimen- 
sional object. 

[0015] Further, according to an embodiment of the 
present invention, when there are a plurality of primary 
surfaces constituting at least one three-dimensional ob- 
ject, tiie series of drawing processes are performed for 
every primary surface in order of distance from the re- 
motest primary surface fnsm the light source such that 
a shadow image of a primary surface is drawn on an- 
other primary surface. 

[0016] Further, according to another embodiment of 
the present invention, when there are a plurality of three- 
dimensional objects, the series of drawing processes 
are performed for every three-dimensional object in or- 
der of distance from the remotest three-dimensional ob- 
ject from the light source such that a shadow image of 
at least one three-dimensional object is drawn on an- 
other three-dimensional object. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[001 7] The invention will now be described by way of 
example with reference to the accompanying drawings, 
throughout which like parts are referred to by like refer- 
ences, and in v^ich: 

FIG. 1 is a view showing an an-angement of an en- 
tertainment system according to the present enrv- 
txxliment; 

FIG. 2 is a view showing an example of addressing 
of an image memory; 

FIG. 3 is a view showing an image of a main char- 
acter and a shadow image of the main character; 
FIGS. 4A through 4D are views for explaining an 
example of generating a shadow image by image 
drawing means according to the present embodi- 
ment; 

FIGS. 5A through 5D are views for explaining an- 
other example of generating a shadow Image by the 
image drawing means according to the present em- 
bodiment; 

FIG.6 Is a functional block diagram of the image 
drawing means according to the present embodi- 
ment; 

FIG. 7 is a flow chart showing a processing se- 
quence (N0.I ) of the image drawing means accord- 
ing to the present embodiment; and 
FIG. 8 is a flow chart showing a processing se- 
quence (No. 2) of the image drawing means accord- 
ing to the present embodiment 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

[001 8] An embodiment of an image drawing method, 
an image drawing apparatus, a recording medium, and 
a program according to the present invention as applied 
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to an entertainment system for executing various pro- 
grams (hereinafter simply referred to as the entertain- 
ment system according to the present embodiment) will 
be described with reference to drawings. 
[0019] As shown in FIG. 1 . the entertainment system s 
10 according to the present embodiment basically com- 
prises an entertainment apparatus 12 for executing var- 
ious programs, a memory card 14 detachably connect- 
ed to the entertainment apparatus 12. a manual control- 
ler 1 6 detachably connected to the entertainment appa- io 
ratus 12, and a monitor (display) 18 such as a television 
receiver which is supplied with video and audio signals 
from the entertainment apparatus 12. 
[0020] The entertainment apparatus 12 reads a pro- 
gram recorded in a mass storage medium such as an is 
optical disk 20 such as a CO-ROM or the like, and exe- 
cutes a game, for example, based on the program de- 
pending on commands supplied from a user, e.g., a 
game player, via the manual controller 16. The execu- 
tion of the game mainly represents controlling the 20 
progress of the game by controlling the display of imag- 
es and the generation of sounds on the monitor 18 
based on manual input actions entered from the manual 
controller 16. 

[0021] As shown in FIG. 1 . the entertainment appara- 25 
tus 12 generally comprises a control system 200, a 
graphic generating system 204 connected to the control 
system 200 via a system bus 202. a sound generating 
system 206 connected to the control system 200 via the 
system bus 202. and an optical disk control system 208 30 
connected to the control system 200 via the system bus 
202. A communication controller 210 for controlling data 
to be inputted to and outputted from the manual control- 
ler 16 and the memory card 14 is also connected to the 
control system 200 via the system bus 202. 35 
[0022] The manual controller 16 supplies commands 
(including manipulation data) from the user via the corxh 
munication controller 210 to the entertainment appara- 
tus 12. The optical disk control system 208 includes an 
optical disk drive 21 2 In which the optical disk 20 is load- ^ 
ed. The optical disk 20 may comprise a CD-ROM or the 
like as a specific example of a recording medium ac- 
cording to the present inventton. 
[0023] The control system 200 controls motions of 
characters displayed on the monitor 1 8 based on a pro- <s 
gram and data read from the optical disk 20 and conn- 
mands supplied from the manual controller 16. 
[0024] The control system 200 includes a micro 
processing unit (MPU) 220. a main memory 222. a pe- 
ripheral devk:e controller 224, a ROM 226, and a real- so 
time dock (RTC) 228. The MPU 220 controls the enter- 
tainment system 12. The main menwry 222 stores var- 
ious programs to be executed and various data. That is, 
the main memory 222 at least stores a game program 
so that the game program can be executed on the main ss 
memory 222. The peripheral device controller 224 con- 
trols interrupts and direct memory access (DMA) data 
transfer. The ROM 226 stores various programs such 



as an operating system for managing the graphic sys- 
tem 204, the sound generating system 206, etc. Further, 
the ROM 226 stores information for controlling kemel or 
the like, and information for performing an OSD function. 
[0025] The MPU 220 controls the entertainment ap- 
paratus 12 in its entirety by executing the operating sys- 
tem stored in the ROM 226. The MPU 220 may comprise 
a 32-blt RISC-CPU, for example. 
[0026] When the entertainment apparatus 12 is 
turned on. the MPU 220 executes the operating system 
stored in the ROM 226 to start controlling the graphic 
generating system 204. the sound generating system 
206, etc. 

[0027] When the operating system is executed, the 
MPU 220 initializes the entertainment apparatus 12 in 
its entirety for checking its operation, and thereafter con^ 
trols the optical disc control system 208 to execute an 
application program such as a game program recorded 
in the optical disk 20. 

[0028] As the application program such as a game 
program is executed, the MPU 220 controls the graphic 
generating system 204, the sound generating system 
206, etc. depending on commands entered from the us- 
er for thereby controlling the display of images and the 
generation of music sounds and sound effects. 
[0029] The graphic generating system 204 comprises 
a vector operation unit 230 for performing floating-point 
vector operations required for geometry processing, an 
image processor 232 for generating image data under 
the control of the MPU 220 and outputting the generated 
image data to a monitor 1 8, e.g., a CRT, a graphic Inter- 
face (GIF) 234 for serving as transfer paths between the 
MPU 220. the vector operation unit 230. and the image 
processor 232, and an image decoder 236 for decoding 
image data compressed and encoded by an orthogonal 
transform such as a discrete cosine transform. 
[0030] The image processor 232 comprises a render- 
ing engine 240. a memory interface 242. an image mem- 
ory 244. and a display controller 246 such as a program- 
mable CRT controller or the like. 
[0031] The rendering engine 240 serves to render and 
store Image data in the Image memory 244 via the mem- 
ory Interface 242 based on a rendering command sup- 
plied from the MPU 220. 

[0032] A first bus 248 is connected between the menv 
ory interface 242 and the rendering engine 240, and a 
second bus 250 is connected between the memory in- 
terface 242 and the image memory 244. Each of the first 
and second buses 248. 250 has a 128-bit width, for ex- 
ample, for allowing the rendering engine 240 to render 
and store image data in the image memory 244 at a high 
speed. 

[0033] The rendering engine 240 is capable of render- 
ing image data of 320 x 240 pixels or image data of 640 
X 480 pixels according to the NTSC or PAL system on 
a real-time fashion, i.e., more than ten times to several 
ten times in 1/60 seconds to 1/30 seconds. 
[0034] The image memory 244 is a unified memory 
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structure that is able to designate a texture rendering 
area and a display rendering area as the same area. For 
example, in FIG. 2. a frame buffer 244a, a Z-buffer 244b. 
and a texture buffer 244c are designated by logical ad- 
dressing in the image memory 244, respectively. Alter- 
natively, the Z-buffer may be separately designated in 
another memory by physical addressing. 
[0035] As shown in FIG. 1 . the display controller 246 
writes texture data read from the optical disk 20 via the 
optical disk drive 212 or texture data generated in ttie 
main memory 222 via the memory interface 242 into the 
texture buffer 244c of the image memory 244, and reads 
image data stored in the frame buffer 244a of the image 
memory 244 via the memory interface 242 and outputs 
the read image data to the monitor 18 to display an im- 
age on its display screen. 

[0036] The sound generating system 206 comprises 
a sound processing unit (SPU) 260 for generating music 
sounds, sound effects, etc. based on Instiiictions from 
the MRU 220, and a sound buffer 262 for storing music 
sounds, sound effects, etc. generated by the SPU 260. 
Audio signals representing music sounds, sound ef- 
fects, etc. generated by the SPU 260 are supplied to 
audio tenninals of the monitor 18. The monitor 18 has 
a speaker 264 which radiates music sounds, sound ef- 
fects, etc. generated by the SPU 260 based on the sup- 
plied audio signals. 

[0037] The SPU 260 has an ADPCM (adaptive differ- 
ential PCM) function for reproducing 16-bit sound data 
which has been encoded as 4-blt differential sound data 
by ADPCM, a reproducing function for reproducing 
wavefonfn data stored in the sound buffer 262 to gener- 
ate sound effects, etc.. and a modulating function for 
modulating and reproducing tiie waveform data stored 
in the sound buffer 262. 

[0038] The sound system 206 with these functions 
can be used as a sampling sound source which gener- 
ates music sounds, sound effects, etc. based on the 
waveform data stored in the sound buffer 262 according 
to Instructions from the MPU 220. 
[0039] The optical disk control system 208 comprises 
an optical disk drive 212 for reproducing application pro- 
grams and data recorded on the optical disk 20, a de- 
coder 270 for decoding programs and data that are re- 
corded with an en-or con-ecting code added thereto, and 
a buffer 272 for temporarily storing data read from the 
optical disk drive 212 so as to allow the data from the 
optical disk 20 to be read at a high speed. A CPU 274 
Is connected to the decoder 270. 
[0040] Sound data recorded on tiie optical disk 20 
which Is read by the optk^al disk drive 212 includes PCM 
data converted from anak>g sound signals. In addition 
to the ADPCM data. 

[0041] The ADPCM data, which Is recorded as 4-bit 
differential data of 16-bit digital data, is decoded by the 
decoder 270, supplied to the SPU 260. converted there- 
by into analog data, and applied to drive the speaker 
264. 



[0042] The PCM data, which is recorded as 16-bit dig- 
ital data, is decoded by the decoder 270 and then 
plied to drive the speaker 264. 
[0043] Next, a characteristic function of the entertain- 
5 ment system 10 according to an embodiment of the 
present invention will be described with reference to 
FIGS.3tiirough 8. 

[0044] In RG. 3, for example, an object as a main 
character 100 In a role playing game Is generated by a 

10 three-dimensional modeling technique. The character- 
istic function of the entertainment system 10 Is to draw 
a shadow image 102 of the main character 100 on the 
background or other objects based on a positional rela- 
tionship between the main character 100 and a light 

15 source. 

[0045] Various objects such as the main character 
100 are used in the role playing game. Each of the ob- 
jects is made up of a plurality of polygons (primary pol- 
ygons). The characteristic function of the entertainment 

20 system 10 Is perfonmed by rendering the plurafity of pri- 
mary polygons one by one for drawing the shadow Im- 
age 102 on the background or other objects. 
[0046] The processing sequence of drawing a shad- 
ow image of a primary polygon selected from the plural* 

25 ity of primary polygons is described below. 

[0047] Firstiy, the selected primary polygon is drawn 
by rendering and hidden surface removal utilizing Z- 
buffering (depth buffering). Next, new secondary poly- 
gons corresponding to the primary polygon are gener- 

30 ated utilizing a light source as a base point Thereafter, 
visible secondary polygons, i.e., the surfaces which are 
visible from a viewing position (camera position) In the 
worid coordinate system (hereinafter also refen-ed to as 
the front-side secondary polygons) are subjected to ren- 

35 dering and hidden surface removal utilizing Z-buffering. 
Then, invisible secondary polygons, i.e., tiie surfaces 
which are not visible from the viewing position (herein- 
after also refen-ed to as the back-side secondary poly- 
gons) are subjected to rendering and hidden surface re- 

40 moval utilizing Z-bufTering. It Is to be understood that 
various light sources such as a point light source and a 
surface light source can be used as the light source. 
[0048] The above-described processing sequence 
will be described more specifically with reference to 

45 FIGS. 4A through 4D. 

[0049] As shown in FIG. 4A, it is assumed tiiat a tri- 
angular primary polygon 110 is positioned above a sur- 
face (for example, a ground surface as a background). 
Firstly, the primary polygon 110 generated by rendering 

50 and hidden surface removal utilizing Z-buffering Is 
drawn in the Image memory 244. 
[0050] Next, as shown In FIG. 4B, new secondary pol- 
ygons 110a through 110c corresponding to the primary 
polygon 110 are generated utilizing a light source 112 

55 as a base point. Specifically, three segments (lines) 
114a through 114c constituting the primary polygon 110 
are subjected to a perspective transformation to the 
ground surface. Then, the three secondary polygons 
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110a through 110c are generated based on coordinate 
values corresponding to vertices of the primary polygon 
110 (vertices of the three segments 114a through 114c) 
and coordinate values con-esponding to vertices of the 
transfomned primary polygon projected on the ground 
surface. 

[0051] Thereafter, as shown in FIG. 4C. the front-side 
secondary polygon 110a Is subjected to rendering and 
hidden surface removal utilizing Z-buffering for drawing 
an image of the secondary polygon 110a. At this time, 
the image of the secondary polygon 110a is drawn In a 
blackish color. 

[0052] Then, the back-side secondary polygons 1 1 0b, 
110c are subjected to rendering and hidden surface re- 
moval utilizing Z-buffering for drawing images of the 
secondary polygons 110b, 110c. At this time, the images 
of the secondary polygons 110b, 110c are drawn such 
that the color (blackish color) of the front-side secondary 
polygon 110a is eliminated. That is, the eliminated por- 
tions of the front-side secondary polygon 110a become 
transparent. 

[0053] By the above drawing processing sequence, a 
shadow image 116 of the primary polygon 110 is gener- 
ated on the ground surface. 

[0054] Next, the processing sequence of drawing a 
shadow image of the primary polygon 110 on another 
object (polygon, moving image, or still image) will be de- 
scribed with reference to FIGS. 5A through 5D. 
[0055] In this example, as shown In FIG. 5A, it is as- 
sumed that there is a spherical object 120 in addition to 
the primary polygon 110. Further, it Is assumed that the 
spherical object 120 is remotely positioned from the light 
source 112 in comparison with the primary polygon 110. 
That is, it is assumed that the shadow image of the pol- 
ygon 110 is to be drawn on the surface of the spherical 
object 120. 

[0055] Images of the primary object 110 and the 
spherical object 120 are drawn in the image memory 
244 In order of distance Irom the remoter object from 
the light source 112a. That is, the spherical object 120 
is drawn first Thereafter, tiie primary polygon 110 is 
drawn In the Image memory 244 after being subjected 
to rendering and hidden surface removal utilizing Z-buff- 
ering. Then, as shown in FIG. 5B, new secondary poly- 
gons 110a through 110c corresponding to the primary 
polygon 110 are generated utilizing a light source 112 
as a base point. 

[0057] Next, as shown In FIG. 5C, the front-side sec- 
ondary polygons 11 Oa is subjected to rendering and hid- 
den sur^ce removal utilizing Z-buffering for dravinng an 
image of the secondary polygon 110a In a blackish color. 
At this time, Z-buffer values for respective pixels of the 
spherical body 120 and the Z-buffer values for respec- 
tive pixels of the front-side secondary polygon 110a are 
compared with each other at portions where pixels of 
the spherical body 120 and pixels of the front-side sec- 
ondary polygon 110a are overlapping with each other. If 
a Z-buffer value for a pixel of tiie front-side secondary 



polygon 110a Is, for example, higher than a Z-buffer val- 
ue for the corresponding (overiapping) pixel of the 
spherical body 1 20, the pixel of the front-side secondary 
polygon 1 1 0a is not drawn. That is, portions of the front- 

5 side secondary polygon 110a hidden by the spherical 
body 120 (pixels where the front-side secondary poly- 
gon 110a has the higher Z-buffer values) are not drawn. 
Witti tiie above process, as shown in FIG. 5C, an image 
showing the spherical body 1 20 pariially cut away by the 

10 front-side secondary polygon 1 1 0a is generated. 

[0058] Then, the back-side secondary polygons 1 1 0b, 
110c are subjected to rendering and hidden surface re- 
moval utilizing Z-buffering for drawing images of the 
secondary polygons 110b, 110c such that the color 

IS (blackish color) of the front-side secondary polygon 
110a is eliminated. At this time, as with the front second- 
ary polygon 110a, the back-side secondary polygons 
110b, 110c are drawn based on comparison between 
the Z-buffer values of the back-side secondary polygons 

20 11 Ob, 1 1 0c and ttie Z-buffer values of the spherical body 
120. That is, portions of the back-side secondary poly- 
gons 110b, 110c hidden by the spherical body 120 are 
not drawn. 

[0059] As shown in FIG. 5D, the blackish color of the 

25 front-side secondary polygon 110a is not eliminated by 
the back-side secondary polygons 110b, 110c at some 
portions where the back-side secondary polygons 110b, 
110c are not drawn based on the comparison between 
the Z-bufFer values of the back-side secondary polygon 

30 1 1 0b. 1 1 0c and the Z-buffer values of the spherical body 
120. That is, a shadow Image of the primary polygon 
110 projected on the surface (spherical surface) of the 
spherical body 120 is generated by the remaining por- 
tion of the front-side secondary polygon 112a drawn in 

35 the blackish color. 

[0060] Next, an example of software (image drawing 
means 300) for carrying out the above-described char- 
acteristic function will be described with reference to 
FIGS 6 through 8. 

40 [0061] The image drawing means 300 can be sup- 
plied fix>m a randomly accessible recording medium 
such as an optical disk 20, a memory card 14 or the like 
to the entertainment apparatus 12. Altematively, the im- 
age drawing means 300 can be downloaded via a net- 

45 work such as the Intemet or downloaded via a satellite 
communication or the like to the entertainment appara- 
tus 12. In the following explanation, it is assumed that 
the image drawing means 300 is supplied from an opti- 
cal disk 20. 

so [0062] Specifically, the optical disk 20 is played back 
by ttie optical disk drive 212 to read the Image drawing 
means 300 and the read image drawing means 300 is 
stored in the main memory 222 in the control system 
200 of the entertainment apparatus 12 by a predeter- 

55 mined process. Thereafter, the image drawing means 
300 is executed by the MPU 220 of the control system 
200 of the entertainment apparatus 12. 
[0063] As shown in FIG. 6. the image drawing means 
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300 comprises drawing order determining means 302, 
primary potygon drawing means 304. secondary poly- 
gon generating means 306, first secondary polygon 
drawing means 308, second secondary polygon draw- 
ing means 310, process determining 312. and image 
displaying means 314. The drawing order detemiining 
means 302 determines the order of drawing objects in 
order of distance from the remotest object fn^m a light 
source 112. The primary polygon drawing means 304 
draws a primary polygon (an element of an object) 110 
according to the detenmined drawing order by rendering 
and hidden surface removal. The secondary polygon 
generating means 306 generates secondary polygons 
110a through 110c con^esponding to the primary poly- 
gon 110 utilizing the light source 112 as a base point. 
The first secondary polygon drawing means 308 draws 
a front-side secondary polygon 110a selected from the 
secondary polygons 110a through 110c by rendering 
and hidden surface removal. The second secondary 
polygon drawing means 310 draws backside second- 
ary polygons 110b, 110c selected from the secondary 
polygons 110a through 110c by rendering and hidden 
surface removal. The process determining means de- 
termines 312 whether or not each of the drawing proc- 
esses has been finished or not The image displaying 
means 314 outputs image data drawn in the image 
menrK>ry 244 to the monitor 18 so that the outputted im- 
age data can be displayed on the screen of the monitor 
18. 

[0064] Next, the processing sequence of the image 
drawing means 300 will be described with reference to 
flow charts shown in FIGS. 7 and 8. 
[0065] It is assumed that positions of objects to be 
drawn by the Image drawing means 300 are defined by 
the wortd coordinate system. 

[0066] In Step S1 of FIG. 7, when the Image drawing 
means 300 receives movement information indicating 
movements of objects, the image drawing means 300. 
rewrites the basic positions (coordinates in the worid co- 
ordinate system) of moved objects. 
[0067] Next, in Step S2, the image drawing means 
300 sets a position of a light source 112. Then, in Step 
S3, the drawing order determining means 302 of the inrt- 
age drawing means 300 determines an order of drawing 
objects. Specifically, the drawing order detenmining 
means 302 determines the order based on the basic po- 
sitions of the objects and the position of the light source 
112 such that data of the objects are read in order of 
distance trom the remotest object from the light source 
112. That is. the objects are drawn in order of distance 
from the remotest object from the light source 112. 
[0068] Then, in Step S4, the image drawing means 
300 stores an initial value "0" in an index register i used 
to retrieve an object, thereby initializing the index regis- 
ter i. 

[0069] Then, in Step S5, the image drawing means 
300 reads data concerning the i-th object. Thereafter, in 
Step S6, the image drawing means 300 stores an initial 



value "0" in an Index register j used to retrieve a primary 
polygon, thereby initializing the index register j. 
[0070] Then, in Step S7, the primary polygon drawing 
means 304 reads data concerning the j-th primary pol- 

5 ygon 110 from the i-th object data read in Step S5. 
[0071] Then, in Step S8, the primary polygon drawing 
means 304 rewrites data conceming vertices of the j-th 
primary polygon 110 based on the basic position of the 
i-th object and optical information (the position of the 

10 light source 112, the type of the light source 112, or the 
like). Then, in Step S9, the primary polygon drawing 
means 304 draws an image of the j-th primary polygon 
110 in the image memory 244 by rendering and hidden 
surface removal utilizing Z-buffering. 

15 [0072] Then, in Step S1 0 of FIG. 8, the secondary pol- 
ygon generating means 306 stores an initial value "0" in 
an index register k used to retrieve a segment, thereby 
initializing the index register k. 
[0073] Then, in Step S1 1 , the secondary polygon gen- 

20 erating means 306 reads the k-th segment constituting 
the primary potygon 110 from the index register k for 
generating the k-th secondary polygon. Spedficalty, the 
secondary polygon generating means 300 perfbrms a 
perspective transformation of the k-th segment to the 

25 ground surface utilizing the light source 112 as a base 
point. The k-th secondary polygon is generated based 
on the position of the k-th segment and the position of 
the transformed k-th segment, i.e., coordinates conre- 
sponding to vertices of the k-th segment and coordi- 

30 nates corresponding vertices to of the k-th segment pro- 
jected on the ground surface. 
[0074] In Step SI 2, the secondary polygon generat- 
ing means 306 updates the value of the index register 
k to be incremented by 1 . Then, in Step SI 3, the process 

35 detemnining means 312 determines whether secondary 
polygons for all of the segments constituting the primary 
polygon 110 have been generated or not. That is, it is 
determined that whether the value of the index register 
k is equal to or more than the number A of the segments 

40 constituting the primary polygon 110 or not. 

[0075] If the value of the index register k is equal to 
or more than the number A of the segments constituting 
the primary polygon 110, the process determining 
means 312 detenmines that secondary polygons for all 

45 of the segments constituting the primary polygon 110 
have been generated. 

[0076] If the process determining means 312 deter- 
mines that secondary polygons for all of the segments 
constituting the primary potygon 1 1 0 have not been gen- 

50 erated, control passes back to Step S1 1 for generating 
another secondary polygon for the next segment. When 
secondary polygons for all of the segments constituting 
the primary polygon 110 are generated, control passes 
to Step S14. In Step S14, the first secondary polygon 

55 drawing means 308 draws an Image of a front-side sec- 
ondary polygon 110a in a blackish color in the image 
memory 244 by rendering and hidden surface removal 
utilizing Z-buffering. 
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[0077] Then, in Step S15. the second secondary pol- 
ygon drawing means 310 draws images of the remain- 
ing back-side secondary potygons 110b, 110c in the im- 
age memory 244 by rendering and hidden surface re- 
moval utilizing Z-buffering. The images of the baclt-side 
secondary polygons 11 Ob, 11 Oc are drawn such that the 
color (blackish color) of the front-side secondary poly- 
gon 110a is eliminated. 

[0078] In Step S1 6. the value of the index register j is 
incremented by 1. Then, in Step SI 7. the process de- 
termining means 312 determines whether all the prima- 
ry potygons 110 constituting the i-th object have been 
drawn or not. That is, it is determined that whether the 
value of the index register j is equal to or more than the 
number B of the polygons constituting the i-th object or 
not If the value of the index register] is equal to or more 
than the number B of the polygons constituting the i-th 
object, the process detennining means 312 determines 
that all the primary polygons constituting the i-th object 
have been drawn. 

[0079] If the process detenmining means 312 deter- 
mines that all the primary polygons 110 constituting the 
object have not been drawn, control passes back to Step 
S7 for drawing another primary polygon 100, and gen- 
erating and drawing secondary polygons 110a through 
110c. 

[0080] When all the primary polygons 110 constituting 
the object are drawn, control passes to Step SIS. In 
Step 81 8, the value of the index register i is inaemented 
by 1 . Then, in Step SI 9, the process determining means 
312 determines whether all the objects have been 
drawn or not. That is. it Is determined that whether the 
value of the index register i is equal to or more than the 
number C of the objects or not. If the value of the index 
register i is equal to or more than the number C of the 
objects, the process determining means 312 deter- 
mines that all the objects have been drawn. 
[0081] If the process detennining means 312 deter- 
mines that all the objects have not been drawn, control 
passes back to Step S5 for performing the process of 
another object, i.e., drawing primary polygons 110, and 
generating and drawing secondary polygons 110a 
through 110c. 

[0082] When all the objects are drawn, control passes 
to Step S20. In Step S20. the image displaying means 
314 outputs image data drawn in the image memory 244 
to the monitor 18 so that the outputted image data can 
be displayed on the screen of the monitor 18. 
[0083] Then, in Step S21, the process determining 
means 312 determines whether there is a program end- 
ing request (game over, power off, etc.) to the image 
drawing means 300 or not. If there is not a program end- 
ing request, control passes back to Step SI for repeat- 
ing the subsequent steps. 

[0084] As described above, according to the enter- 
tainment system 1 0 of the present embodiment, the new 
secondary polygons 110a through 110c con-esponding 
to each of at least one primary polygon 1 1 .0 constituting 



a three dimensional object are generated utilizing the 
light source 112 as a base point Then, the front-side 
secondary polygon 110a selected from the secondary 
polygons 1 1 0a through 1 1 0c is drawn. Then, the remaln- 

5 ing back-side secondary polygons 1 1 0b, 1 1 0c are drawn 
such that the color of the front-side secondary polygon 
110a is eliminated. Accordingly, it is possible to easily 
generate shadow images of a plurality of objects in a 
complicated positional relationship, or generate a shad- 

10 ow image of an object having a compibated shape with- 
out using a stencil buffer or the like. 
[0085] Since a shadow image is generated when the 
back-side secondary polygons 110b, 110c for partially 
eliminating the front-side secondary polygon 110a is 

15 drawn, It is no more necessary to draw semi-transparent 
polygons in a blackish color in the last step. Therefore, 
the number of processes can be effectively decreased. 
[0086] In particular, according to the present embod- 
iment, three-dimensional infonnation conceming an ob- 

20 ject on which a shadow is projected (the spherical body 
in the example shown in FIG. 5A) is not necessary in 
drawing a shadow innage. That is. Information concem- 
ing two-dimensional images in an image memory and 
Z-buffer values for respective pixels of the two-dimen- 

25 sional images are only needed. 

[0087] The image drawing method, the image draw- 
ing apparatus, the recording medium, and the program 
according to the present invention shall not be limited to 
the particular embodiment disclosed herein. It will be ap- 

30 parent to a person skilled in the art ttiat numerous mod- 
ifications and variation may be made without departing 
from the scope of the Invention. 



35 Claims 

1. A method of drawing a shadow image of at least 
one primary surface (110) constituting a ttiree-di- 
mensional object (1 00). said method comprising the 

40 steps of: 

generating new secondary surfaces (110a, 
110b, 110c) based on said primary surface 
(110) utilizing a light source (112) as a base 

45 point; 

drawing a first image of a front-side secondary 
surface (110a) selected trom said secondary 
surfaces (110a, 110b, 110c); and 
drawing a second image of a back-side second- 

50 ary surface (110b, 110c) selected from said 

secondary surfaces (110a, 110b, 110c), 
wherein said second image is drawn such that 
said first image is partially eliminated by said 
second image, thereby generating said shadow 

55 image of said primary surface (110). 

2. An image drawing method according to claim 1. 
said method further comprising the step of; 
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drawing said primary surface (110) by render- 
ing and hidden surface removal, 
wherein said first and second images of said 
secondary surfaces (110a, 110b, 110c) are 
drawn by rendering and hidden surface remov- s 
al. 

3. An image drawing method according to claim 2, 
wherein a series of drawing processes performed 

in said steps of drawing said primary surface (110). io 
generating said secondary surfaces (110a, 110b, 
110c), and drawing said first and second images of 
said secondary surfaces ( 1 1 0a, 1 1 0b, 1 1 0c) are per- 
formed for every primary surface (110) constituting 
said three-dimensional object ( 1 00), thereby draw- is 
Ing an Image of said three-dimensional object (100) 
and a shadow Image (1 02) of said three-dimension- 
al object (100). 

4. An image drawing method according to claim 3, 20 
wherein when there are a plurality of primary sur- 
faces (110, 120) constituting at least one three-di- 
mensional object (100), said series of drawing proc- 
esses are perfomied for every primary surface (110. 

1 20) in order of distance from the remotest primary 25 
surface from said light source (112) such that a 
shadow image (116) of a primary surface (110) is 
drawn on another primary surface (120). 

5. An image drawing method according to claim 3. 30 
wherein when there are a plurality of three-dimen- 
sional objects, said series of drawing processes are 
performed for every three-dimensional object in or- 
der of distance fi^om the remotest three-dimensional 
object from said light source (112) such that a shad- 35 
ow image of at least one three-dimensional object 

is drawn on another three-dimensional object. 

6. An Image drawing method according to any one of 
claims 2 through 5, wherein Z-buffering is utilized in 
performing said hidden surface removal. 

7. An image drawing apparatus comprising means 
(300) for drawing a shadow image of at least one 
primary surface (110) constituting a three-dimen- ^ 
slonal object (100). said means (300) for drawing a 
shadow image comprising: 

means (306) for generating new secondary sur- 
faces (1 1 0a, 1 1 0b, 1 1 0c) based on said primary so 
surface (110) utilizing a light source (112) as a 
base point; 

means (308) for drawing a first image of a front- 
side secondary surface (110a) selected from 
said secondary surfaces (110a, 110b, 110c); ss 
and 

means (310) for drawing a second Image of a 
back-side secondary surface {110b, 110c) se- 



lected from said secondary surfeoes (110a. 
110b. 110c). 

wherein said second image is drawn such that 
said first image is pariially eliminated by said 
second image, thereby generating said shadow 
image of said primary surface (110). 

8. An image drawing apparatus according to claim 7, 
said means (300) for drawing a shadow image fur- 
ther comprising: 

means (304) for drawing a primary surface 
(110) by rendering and hidden surface removal, 
wherein said first and second images of said 
secondary surfaces (110a, 110b, 110c) are 
drawn by rendering and hidden surface remov- 
al. 

9. An image drawing apparatus according to claim 8, 
said means (300) for drawing a shadow image fw*- 
ther comprising means (312) for canrying out a se- 
ries of drawing processes performed by said means 
(304) for drawing a primary surface (110), said 
means (306) for generating new secondary surfac- 
es (110a, 110b. 110c), said means (308) for drawing 
a first image, and said means for generating a sec- 
ond image for every primary surface (110) consti- 
tuting said three-dimensional object (100), thereby 
drawing an image of said three-dimensional object 
(100) and a shadow Image (102) of said three-di- 
mensionai object (100). 

10. An Image drawing apparatus according to daim 9, 
said means (300) for drawing a shadow image fur- 
ther comprising means (302) for determining a 
drawing order when there are a plurality of primary 
surfaces (110, 120) constituting at least one three- 
dimensional object (100), wherein said drawing or- 
der is detemnined such that said series of drawing 
processes are performed for every primary surface 
(110, 120) in order of distance firom the remotest 
primary surface firom said light source (112). there- 
by drawing a shadow image (116) of a primary sur- 
face (110) on another primary surface (120). 

11. An image drawing apparatus according to claim 9, 
said means (300) for drawing a shadow image fur- 
ther comprising means (302) for determining a 
drawing order when there are a plurality of three- 
dimensional objects, wherein said drawing order is 
determined such that said series of drawing proc- 
esses are performed for every three-dimensional 
object in order of distance from the remotest three- 
dimensional object from the light source (112), 
thereby drawing a shadow Image of at least one 
three-dimensional object on another three-dimen- 
sional object 



10 



17 



EP1 126 415 A2 



18 



12. An image drawing apparatus according to any one 
of claims 8 through 11, wherein 2-buffering is uti- 
lized in perfomiing said hidden surface removal. 

13. A recording medium for recording a program and 
data for use of an image drawing apparatus (12) for 
drawing image data in an image memory (244) and 
outputting said image data drawn in said image 
memory (244) to a monitor (1 8) so that said output- 
ted Image data can be displayed on said monitor 
(18), said program comprising the steps of; 

generating new secondary surfaces (110a, 
110b, 110c) based on said primary surface 
(110) utilizing a light source (112) as a base 
point; 

drawing a first image of a front-side secondary 
surface (110a) selected from said secondary 
surfaces (110a, 110b. 110c); and 
drawing a second image of a back-side second- 
ary surface (110b, 110c) selected from said 
secondary surfaces (110a, 110b, 110c). 
wherein said second image is drawn such that 
said first image is partially eliminated by said 
second image, thereby generating said shadow 
Image of said primary surface (110). 

14. A recording medium according to claim 1 3, wherein 
said program further comprising the step of: 

drawing said primary surface (110) by render- 
ing and hidden surface removal, 
wherein said first and second images of said 
secondary surfaces (110a, 110b, 110c) are 
drawn by rendering and hidden surface remove 
al. 

15. A recording medium according to claim 1 4. said pro- 
gram comprising a processing routine for carrying 
out a series of drawing processes perfomried in said 
steps of drawing said primary surfece (110), gener- 
ating said secondary surfaces (110a. 110b, 110c), 
and drawing said first and second images of said 
secondary surfaces (110a, 110b, 110c) for every pri- 
mary surface (110) constituting said three-dimen- 
sional object (100), thereby drawing an image of 
said three-dimensional object (100) and a shadow 
image (102) of said three-dimensional object (100). 

1 6. A recording medium according to claim 1 5, said pro- 
gram further comprising a processing routine for de- 
termining a drawing order when there are a plurality 
of primary surfaces (110, 120) constituting at least 
one three-dimensional object (100), wherein said 
drawing order is determined such that said series 
of drawing processes are performed for every pri- 
mary surface (110, 120) in order of distance from 
the remotest primary surface from said light source 



(112), thereby drawing a shadow Image (116) of a 
primary surface (110) on another primary surface 

(120). 

5 17. A recording medium according to claim 15, said pro- 
gram further comprising a processing routine for de- 
temnining a drawing order where there are plurality 
of three-dimensional objects, wherein said drawing 
order is determined such that said series of drawing 

10 processes are performed for every three-dimen- 
sional objects in order of distance from the remotest 
three-dimensional object from said light source 
(112) thereby drawing a shadow image of at least 
one three-dimensional object on another three-di- 

15 menslonal object. 

18. A recording medium according to any one of claims 
14 through 17, wherein said Image drawing appa- 
ratus (1 2) comprises a Z-bufFer (244b). 

20 

19. A program readable and executable by a computer 

for use of an image drawing apparatus (12) for 
drawing image data in an image memory (244) and 
outputting said image data drawn in said image 
25 memory (244) to a monitor ( 1 8) so that said output- 
ted image data can be displayed on said monitor 
(18), said program comprising the steps of; 

generating new secondary surfaces (110a, 
30 110b. .110c) based on said primary surface 

(110) utilizing a light source (112) as a base 
point; 

drawing a first image of a front-side secondary 
surface (110a) selected from said secondary 

35 surfaces (110a, 110b, 110c); and 

drawing a second image of a back-side second- 
ary surface (110b, 110c) selected from said 
secondary surfaces (110a, 110b. 110c), 
wherein said second image is drawn such that 

40 said first image is partially eliminated by said 

second image, thereby generating said shadow 
image of said primary surfece (110). 
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